A Framework for Rapid Multimodal Application Design
نویسندگان
چکیده
The aim of the work described in this paper is to extend the EPFL dialogue platform with multimodal capabilities. Based on our experience with the EPFL Rapid Dialogue Prototyping Methodology (RDPM), we formulate precise design principles that provide the necessary frame to use the RDPM to rapidly create an efficient multimodal interface for a given application. We analyze the consequences of the proposed design principles on the generic GUI and architecture required
منابع مشابه
The multimod application framework: A rapid application development tool for computer aided medicine
This paper describes a new application framework (OpenMAF) for rapid development of multimodal applications in computer-aided medicine. MAF applications are multimodal in data, in representation, and in interaction. The framework supports almost any type of biomedical data, including DICOM datasets, motion-capture recordings, or data from computer simulations (e.g. finite element modeling). The...
متن کاملRapid Multimodal Dialogue Design: Application in a Multimodal Meeting Retrieval and Browsing System
In this paper we present an extension of the EPFL’s Rapid Dialogue Prototyping Methodology to include multimodality, and show how it can be applied in the design of a multimodal application, the Archivus system. We begin with an overview of the standard speechonly rapid dialogue prototyping methodology, followed by a discussion of the extensions implemented to include multimodal capabilities. W...
متن کاملMultimodal Dialog Management
Unreliable speech recognition, especially in noisy environments and the need for more natural interaction between man and machine have motivated the development of multimodal systems using speech, pointing, gaze, and facial expressions. In this paper we present a new approach to fuse multimodal information streams using agents. A general framework based on this approach that allows for rapid ap...
متن کاملOntology-driven Multimodal Interface Design for an Emergency Response Application
In this paper, we propose an ontology-driven modelling framework, which allows to capture the domain and expert knowledge available within the interface design community, and to support designers in their daily design tasks by eliciting user and application dependent design recommendations. We illustrate how this framework can be used in practice with a concrete case study devoted to multimodal...
متن کاملThe SmartKom Architecture: A Framework for Multimodal Dialogue Systems
SmartKom provides an adaptive and reusable dialogue shell for multimodal interaction, which has been employed successfully to realize fully-fledged prototype systems for various application scenarios. Taking the perspective of system architects, we will give a review of the overall design and specific architecture framework being applied within SmartKom. The basic design principles underlying o...
متن کامل